Findings of the IWSLT 2022 Evaluation Campaign.

The evaluation campaign of the 19th International Conference on Spoken Language Translation featured eight shared tasks: (i) Simultaneous speech translation, (ii) Offline speech translation, (iii) Speech to speech translation, (iv) Low-resource speech translation, (v) Multilingual speech translation, (vi) Dialect speech translation, (vii) Formality control for speech translation, (viii) Isometric speech translation. A total of 27 teams participated in at least one of the shared tasks. This paper details, for each shared task, the purpose of the task, the data that were released, the evaluation metrics that were applied, the submissions that were received and the results that were achieved

High-performance inverted index database

The goal of this thesis is to implement an inverted-index database software that provides improvements in handling raw non-textual data, which is beneficial for several areas of research. The main internal structures of the library are designed to be cache-oblivious, also aiming to reduce the size of stored data. This thesis includes an overview of common inverted index implementation methods and describes retaled structures in a suitable cache-based model. This resulted in improvements of compression ratio, and performance similar to currently available highly optimized databases. The benchmark conducted on cheminformatic data has shown that the resulting software is applicable as an immediate, efficient replacement of the storage back-ends of specialized molecule databases

Vysoce výkonná databáze invertovaných indexů

Cieľom práce je implementovať databázu invertovaných indexov, ktorá poskytuje zlepšenie v spracovaní netextových dát, čo je obzvlášť prínosné v niekoľkých oblastiach výskumu. Hlavné dátové štruktúry databázy sú navrhnuté tak, aby boli cache-oblivious a súčasne redukovali veľkosť ukladaných dát. Táto práca zahŕňa prehľad bežných metód, ktoré invertované indexy implementujú, a opisuje príbuzné štruktúry vo vhodnom cache modeli. To vedie k zlepšeniu kompresie a podobnému výkonu ako majú aktuálne dostupné, vysoko výkonné databázy. Meranie vykonané na chemicko-informatických dátach ukázalo, že software je použiteľný ako okamžitá účinná náhrada back-endov špeciálnych molekulových databáz.The goal of this thesis is to implement an inverted-index database software that provides improvements in handling raw non-textual data, which is beneficial for several areas of research. The main internal structures of the library are designed to be cache-oblivious, also aiming to reduce the size of stored data. This thesis includes an overview of common inverted index implementation methods and describes retaled structures in a suitable cache-based model. This resulted in improvements of compression ratio, and performance similar to currently available highly optimized databases. The benchmark conducted on cheminformatic data has shown that the resulting software is applicable as an immediate, efficient replacement of the storage back-ends of specialized molecule databases.Katedra softwarového inženýrstvíDepartment of Software EngineeringFaculty of Mathematics and PhysicsMatematicko-fyzikální fakult

Presentation of simultaneous speech translation

The goal of the thesis is to examine methods for presenting the outputs of simul- taneous speech translation systems to users. Compared to manually edited subtitles in movies, current translation systems achieve lower quality in automatic subtitling due to limitations of reading speed and space constraints. Therefore, this thesis examines possibilities of relaxing these constraints, achieving an improvement in overall quality of translated speech presentation. The work relies on existing translation and speech recognition systems, proposing methods solely for user evaluation of the presentation. It provides a thorough analysis of selecting the best layout from a number of presenta- tion options, recommending its usage given available resources. The experimenting is performed given our proposed interface for subtitling and testing. Additionally, the re- sults bring new insights to the relation between the evaluation methods, suggesting less time-consuming evaluation for specific usecases in future experiments.

Continuous Rating; Supplementary materials

Collected data from Continuous Rating evaluation study; collected Continuous Rating scores and Questionnaires

FINDINGS OF THE IWSLT 2022 EVALUATION CAMPAIGN

The evaluation campaign of the 19th International Conference on Spoken Language Translation featured eight shared tasks: (i) Simultaneous speech translation, (ii) Offline speech translation, (iii) Speech to speech translation, (iv) Low-resource speech translation, (v) Multilingual speech translation, (vi) Dialect speech translation, (vii) Formality control for speech translation, (viii) Isometric speech translation. A total of 27 teams participated in at least one of the shared tasks. This paper details, for each shared task, the purpose of the task, the data that were released, the evaluation metrics that were applied, the submissions that were received and the results that were achieved

Findings of the IWSLT 2023 Evaluation Campaign

This paper reports on the shared tasks organized by the 20th IWSLT Conference. The shared tasks address 9 scientific challenges in spoken language translation: simultaneous and offline translation, automatic subtitling and dubbing, speech-to-speech translation, multilingual, dialect and low-resource speech translation, and formality control. The shared tasks attracted a total of 38 submissions by 31 teams. The growing interest towards spoken language translation is also witnessed by the constantly increasing number of shared task organizers and contributors to the overview paper, almost evenly distributed across industry and academia